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(54) Method and system for multimedia conferencing 



(57) A multipoint control unit (104) is provided which 
allows for dynamic codec selection. According to one 
embodiment the MCU (104) causes endpoints (102, 
106) to renegotiate their codec selections if a most-com- 



monly available codec Is not being used, upon entry of 
new parties to a teleconference. Alternatively, the codec 
renegotiation may be performed each time a user 
speaks, to optimize for maximum transmission quality 
or for minimizing transcoding. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to telecommuni- 
cations systems and, particularly, to an improved sys- 
tem and method for multimedia conferencing. 
[0002] The ITU-T (International Telecommunications 
Union Telecommunications Sector) Recommendation 
H.323 defines a set of protocols for communicating us- 
ing audio, video and data over packet-switched net- 
works. To accommodate multipoint conferences (i.e., 
those involving three or more parties), the Recommen- 
dation H.323 defines a multipoint control unit (MCU) to 
coordinate the conferencing. In particular, the MCU is 
required by the Recommendation H.323 to include a 
multipoint controller (MC), which handles H.245 signal- 
ing. In addition, the MCU may Include one or more 
multipoint processors (MP), which mix and process the 
data streams, 

[0003] The MPs may also provide conversion, or 
transcoding, between different codecs. However, typical 
MPs transmit at the highest quality codec each user will 
support, whether or not it is necessary. For example, if 
someone with a high quality Q.711 codec is talking, us- 
ing the "best codec" method allows everyone to receive 
the voice with the highest possible quality from the co- 
dec. However, if someone with a lower quality codec (e. 
g., G.723) is 3peaking, their voice is distributed to the 
G.711 users with G.711, which is wasteful. 
[0004] This process is illustrated schematically by 
way of an example in Table 1 and FIG. 1A and 1B. In 
the example shown in Table 1, User A ha3 GSM, G.723, 
and G.711 capabilities; User B has G.711 and G.723 ca- 
pabilities; User G has G.723 capabilities; and User D 
has GSM capabilities. 

Table 1 



User A 


UserB 


UserC 


User D 


GSM 


G.711 


G.723 


GSM 


G.711 


G.723 






G.723 









[0005] As shown in PIG. 1A, if User A communicates 
in a two-party conference with User B, G.711 will be 
used, if possible. If not, then the G.723 codecs will be 
used. Then, suppose User B calls User C and confer- 
ences in User C using the conference feature. The co- 
dec choice is negotiated and the MCU 103 is inserted 
Into the media stream to provide transcoding. As shown 
in FIG. 1B, the MCU 103 communicates with User A and 
User B using G.711, and with User C using G.723. If a 
User D having only GSM Is added to the conference, 
then MCU 103 will communicate with the User D using 
only GSM. 

[0006] The amount of transcoding the MCU 1 03 must 
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do depends upon which party is talking. When User A 
talks. User a receives the signal as is, and User C and 
User D require transcoding. When User 3 talks, User A 
receives the signal as is, and User C and User D require 
transcoding. When User C talks, Users A, B and D re- 
quire transcoding. When User D talks, Users A, B, and 
C require transcoding. 

[0007] The prior art thus is disadvantageous in that 
the MCU is required to perform transcoding which may 
be sub-optimal or even unnecessary. As such, the prior 
art MC Us can waste processing resources. 

SUMMARY OF THE INVENTION 

[0008] These and other drawbacks in the prior art can 
be addressed by a multipoint control unit (MCU) embod- 
ying the present invention. According to one implemen- 
tation , the MCU determines an optimal codec, for exam- 
ple, based on a highest quality "most common codec" 
among parties to a multipoint conference. Alternatively, 
the optimal codec may be chosen to minimize transcod- 
ing. The MCU instructs any parties not using that codec 
to renegotiate their connections with the MCU to employ 
that codec. The determination is made as each party is 
added to the multipoint conference. 
[0009] According to another embodiment, the codec 
optimization is made every time a different party talks. 
As each party is identified, the MCU issues commands 
tD renegotiate the connections with the endpotnts. 
Again, the codec may be chosen to maximize quality or 
to minimize transcoding. 

[001 0] According to another embodiment, a particular 
party is chosen as having a default codec. That party is 
chosen as being allowed its highest quality codec, with 
other parties receiving at their highest qualities possible. 
However, when the other parties transmit* they send 
with a lower quality codec to preserve bandwidth. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] A better understanding of the invention is ob- 
tained when the following detailed description is consid- 
ered In conjunction with the following drawings in which: 

FIG. lAand FIG. 1B illustrate operation of an MCU 
according to the prior art; 

FIG. 2 illustrates a telecommunications network ac- 
cording to an embodiment of the invention; 
FIG. 3 illustrates a multipoint control unit according 
to an embodiment of the invention; 
FIG. 4 is a flowchart illustrating operation of an em- 
bodiment of the invention; 

FIG. 5 is a diagram schematically illustrating oper- 
ation of an exemplary implementation of the inven- 
tion; 

FIG. 6 is a flowchart illustrating operation of an em- 
bodiment of the Invention; 
FIG. 7 Is a diagram schematically Illustrating oper- 
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ation of an exemplary implementation of the inven- 
tion; 

FIG. 8 is a flowchart illustrating operation of an em- 
bodiment of the invention; 

FIG. 9 is a diagram schematically illustrating oper- 5 
ation of an exemplary implementation of the inven- 
tion; and 

FIG. 10 is a flowchart illustrating operation of anoth- 
er embodiment of the invention. 

10 

DETAILED DESCRIPTION OF THE INVENTION 

[0012] FIGS. 2-10 illustrate an improved multipoint 
conferencing system and method. An embodiment of 
the present invention provides for more optimal seleo te 
tlon of codecs In a multipoint control unit. Optimal selec- 
tion of codecs may be based on minim king bandwidth 
use. minimizing transcoding, or maximizing transmis- 
sion quality. Moreover, such optimization may occur ei- 
ther as new users are added to the multipoint confer- a> 
ence, or as particular users begin speaking. Finally, one 
or more users may be assigned a fixed higher or lower 
quality codec throughout the conference. 
[0013] Turning now to the drawings, and with partic- 
ular attention to FIG. 2, a diagram illustrating an exam- 25 
plary H.323 telecommunications system 100 according 
to an embodiment of ins present invention is shown. It 
is noted that, while described specifically in the context 
of voice packets, the present invention encompasses 
the use of any multimedia information, such as video, 30 
data, voice, or any combinations thereof. Moreover, an 
exemplary generic H.323 system is the Siemens Hi- 
Net™ RC 3000 system available from Siemens. 
[0014] The telecommunications system 100 includes 
a local area network (LAN) or packet network 1 01 . Cou- 35 
pled to the LAN 1 01 may be a variety of H.323 terminals 
102a, 102b, 102c, 102d ( a multipoint control unit (MCU) 
104 according to the present Invention, an H.323 gate- 
way 106, an H.323 gatekeeper 108, a LAN server 112 
and a plurality of other devices such as personal com- <o 
puters (not shown). The H.323 terminals 102a, 102b, 
102c, I02d and H.323 gateway 106 and H.323 gate- 
keeper 108 are in compliance with the H.323 Recom- 
mendation. H.323 terminals 102 and H.323 gateway 
106 are each "endpoints" as may be discussed below. 45 
The H.323 endpoints support H.245 control signaling for 
negotiation of media channel usage, Q.931 (H.225.0) 
for call signaling and call setup, H.225.0 Registration, 
Admission, and Status (RAS), and RTP/RTCP for se- 
quencing audio and video packets. The H.323 end- 50 
points may further implement audio and video codecs, 
T.120 data conferencing protocols and MCU capabili- 
ties. Further details concerning the H.323 Recommen- 
dation may be obtained from the International Telecom- 
munications Union; the H.323 Recommendation is & 
hereby Incorporated by reference in its entirety as if folly 
set forth herein. 

[0015] The MCU 104 Includes a Transcoding Control 
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Unit (TCU) 105. As shown in FIG. 3, the TCU 105 is 
coupled to a Multipoint Processor (MP) 110 and a 
Multipoint Controller (MC) 112. The MP 110 performs 
the actual media signal processing, i.e., switching, and 
the (Ike. The MC 112 handles H.245 capability negotia- 
tions to determine existence of a common codec. As will 
be explained in greater detail below, the TCU 105 pro- 
vides for more optimal selection of the codec which is 
to be used. The TCU 105 is programmed with the codec 
information for each of the users. When the conference 
is set up, the TCU 105 determines what common codec, 
if any, each of the parties possess, and causes a sign- 
aling message, RenegotiateCodec, to be relayed to par- 
ties to the conference that they will have to use the com- 
mon codec ff they are not currently using the common 
codec, they will need to renegotiate this portion Of the 
call set-up with the MCU 104. It is noted that, while 
Shown as discrete units, the MC 112, MP 110 and TCU 
105 may be embodied as one or mora integrated proc- 
essors. Thus, the figures are exemplary only. 
10016] Turning now to FIG. 4, a flowchart inustrating 
general operation of an embodiment of one aspect of 
the present invention is shown. First, in a step 400, the 
MCU 104 receives codec setup information concerning 
each of the parties on the network. The TCU 105 stores 
this information in a database (not shown), in a step 402. 
During a multipoint conference, the MCU 104 identifies 
the parties and accesses the database for their codec 
information, in a step 404. If predetermined optimization 
criteria are met through use of the default codecs, then 
In a step 403, the connections (In step 412) are negoti- 
ated using the defautts. As will be discussed in greater 
detail below, the optimization criteria may include mini- 
mizing transcoding, maximizing quality, or other desired 
criteria. Turning back to FIG. 4, if the optimization criteria 
are not met, then in a step 410, the MCU 109 and par- 
ticularly, the TCU 105 instructs the codecs of all con- 
cerned parties that the connections (in step 412) are to 
be renegotiated for optimal codec usage. 
[0 01 7] A first embodiment of the invention is illustrat- 
ed schematically by way of example with reference to 
FIG. 5. Jn the example of FIG. 5, the optimal coding 
choice to minimize transcoding is made every time a 
new user Is added. In this example, the users have the 
codfng capabilities as set forth in Table 1. Thus, User A 
has GSM, G.723, and G.711 capabilities; User B has G. 
711 and G.723 capabilities; User C has G.723 capabil- 
ities; and User D has GSM capabilities. 
[001 8] If User A communicates with User B, G.711 will 
be used, if possible. If not then the G.723 codecs will 
be used. Then, suppose User B calls User C and con- 
ferences in User C using the conference feature. The 
codec choice is then renegotiated on the fly as shown 
in FIG. 5. That is, User A will now communicate with the 
MCU 104 using G.723, User B will communicate with 
MCU 104 using G.723, and User C will communicate 
with the MCU 104 using G.723. Thus, in the example of 
FIG. 5, the User A and the User B will need to renego- 
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tiate (from G.711 to G.723). Once this is done, no trans- 
coding is needed because a!! the codecs are G.723. 
[0019] Next if a User D is added to the conference, 
the MCU 104 will communicate with it using GSM, since 
that te the only codec supported by the User D. If GSM 
is preferred by She MCU. then User A could be required 
to renegotiate the connection using GSM. 
[0020] As can be appreciated, depending on which 
party is talking, the MCU 104 may have little or no trans- 
coding to do. When User A talks using G.723 coding. 
User B and C receive the signal as is. and User D re- 
quires transcoding. When User B talks, Users A and C 
receive the signal as Is, and User D requires transcod- 
ing. Whan User C talks, Users A and B receive the signal 
as is, and User O requires transcoding. When User D 
talks, Users A, B, and C ail require transcoding. Never- 
theless, the amount of transcoding needed Is less than 
in thB case of FIG. 1A-1B. Moreover, In this embodi- 
ment, when each party Is added, the optimal coding 
choice to minimize transcoding is made. For example, 
if Users E, F> and G were added, all with only GSM ca- 
pabilities, then User A would be switched to GSM, since 
a majority Of the users support GSM rather than G.723. 
[0021] A flowchart illustrating operation of this embod- 
iment is shown in greater detail with reference to FIG. 
8. Fn a step 602, the MCU 104 and, in particular, the TCU 
105 receives information concerning endpoints on the 
nework and their coding capabilities and stores them in 
a memory or database {not shown). In a step 604, the 
MCU 104 and, particularly, the MC 112. receives the 
multipoint conference call set-up commands, including 
identification of the users and their requested codecs. 
In a step 606, the TCU 105 receives the identification 
and codec requests, and accesses the user-codec da- 
tabase to organize the users by type of codec and de- 
termine the most common codec In certain Instances, 
a quality "floor* orthreshold may also be provided. Next, 
in a step 608, the TCU 105 determines whether the most 
common codec is in use or has been requested by alJ 
the users to the conference. If so, then the conference 
will proceed, in a step 610. If not, then in a step 612, the 
TCU 105 will cause the MC 112 to issue a Renegctiata- 
Codec command to the relevant users. The Renegoti- 
ateCodec command may include, as a parameter, an 
identification of the particular codec which is to be used. 
In a step 61 4, the relevant user sends a call setup com- 
mand which is received by the MCU 104*s MC 112. ThB 
MC 112 recognizes the call setup command as pertain- 
ing to the particular conference and, in a step $16 un- 
dertakes the appropriate H.323 cat I control and signal- 
ing commands to set up the new connection using the 
new codec. Once the new connection has been estab- 
lished, in a step 618, the old connection is dropped. Fi- 
nally, in a step 620, the conference proceeds using the 
new codec selections. 

[0022] The embodiment described above modifies 
the coding choice as partes are added and dropped 
from the conference. In a second embodiment, howev- 



er, the coding choice is modified every time a different 
party talks* Thus, every time a new party talks, that party 
is identified as the dominant party by the MCU 1 04 and 
the MCU 104 issues the proper signals to renegotiate 

s the rates with the endpoints. For example, turning to 
FIG. 7A, the example of Table 1 is again used. If User 
A is talking in a conference involving Users A, B, C, and 
D, then the connections should appear as in FIG. 7A, if 
the quality of the connection is to be maximized. That 

10 is, the Users A and B communicate with the MCU 104 
using G.711; the User C communicates with the MCU 
104 using G.723; and the User D communicates with 
the MCU 104 using GSM. Alternatively, if transcoding is 
to be minimized, then the connections will be as shown 

« In FIG. 7B. Thus. Users A, B, and C all communicate 
with the MCU using G.723; and User D communicates 
using GSM. 

[0023] . A flowchart illustrating this embodiment of the 
invention Is shown in FIG. 8. In a step 802, the multipoint 

20 conference Is set up via the MCU 1 04. In a step 804, the 
TCU 105 receives the user Identification and codec re- 
quests, and accesses the user-codec database. In a 
step 806. the TCU 105 detects a new user talking. In 
response, in a step 806, the TCU 106 accesses the da- 

25 tabase to determine whether codec usage Is optimized. 
As discussed above, codec usage may be optimized to 
maximize quality of minimize transcoding. Next, in a 
step 810, the TCU 105 determines whether any of the 
users must renegotiate their codecs for optimization, rf 

30 not, then in a step 824, the conference proceeds. How- 
ever, if they do, then in a step 812, the TCU 105 sends 
an identification of the user to the MC 112. The MC 112 
will issue a RenegotiateCodec command to the relevant 
users in a step 814. The RenegotiateCodec command 

3S may include, as a parameter, an identification of the par- 
ticular codec which is to be used. In a step 316, the rel- 
evant user sends a call setup command which b re- 
ceived by the MCU 104's MC 112. The MC 112 recog- 
nizes the call setup command as pertaining to the par- 

40 ticular conference and, in a step 816, undertakes the 
appropriate H.323 call control and signaling commands 
to set up the new connection using the new codec. Once 
the new connection has been established, in a step $20, 
the old connection is dropped. Finally, In a step 822. the 
« conference proceeds using the new codec selections, 
until a new user talks and the system cycles back to step 
806. 

[0D24] In another embodiment of the invention, the 
MCU 104 is configured to receive an identification of a 
so particular user as a primary user, ali others are identified 
as secondary. For example, in a teacher/lecturer envi- 
ronment, it may be desirable to provide the teacher with 
the highest quality codec when speaking, but the stu- 
dents with a lower quality one when questioning. In this 
case, the MCU 104 will cause the connection from the 
primary user and to the secondary users to be the high' 
est quality possible. The connection from the secondary 
users will be at a lower quality, to preserve system band- 
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width. For example, assume that user capabilities are 
as defined in Table 1. If User A is chosen as the primary 
user, then its connection to the MCU 104 will ba made 
using G.711 . As shown in FIG. 9 t the MCU 1 04 will com- 
municate to the Users B t C and D using their highest 
quality codecs; G.711, G.723, and GSM, respectively. 
However, the Users B, C< and D wit I communicate to the 
MCU using a lower quality codec, if supported. Thus, 
User B will communicate to the MCU with G.723. 
This process is illustrated in greater detail with reference 
to FIG. 10. As shown, in a step 950, the TCU 105 re- 
ceives an identification of a primary and one or more 
secondary users, in a step 952> the multipoint confer- 
ence among those users begins. In a step 954, the sys- 
tem determines whether the primary user is speaking. 
If so, then In a step 950, the highest quality coding is 
used. If that coding Is not currently being employed, then 
the connections are switched, In a manner similar to that 
described above. However If In step 956 a secondary 
user was speaking, then in a step 958, tower quality co- 
decs are used, if such coding is not currently being em- 
ployed, then the coding Is changed in a manner similar 
to that described above. 
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Claims 



ing among two or more parties to a multipoint con- 
ference, the method characterized by; 

optimizing an amount of transcoding required 
to be performed by said transcoding to one or more 
predetermined criteria- 

A method according to Claim 6, wherein said opti- 
mizing optimizes upon entry of new parties to a 
multipoint conference. 

8. A method according to Claim 6, wherein said opti- 
mizing optimizes upon a new party communication. 

9. A method according to Claim 6, said predetermined 
criteria comprising minimizing an amount of trans- 
Coding required to be performed by said transcod- 
ing. 

10. A method according to Claim 6, said predetermined 
criteria comprising maximizing a coding quality. 

11. A method according to Claim 6, said predetermined 
criteria comprising assigning one or more of said 
parties to a predetermined codec and others of said 
parties to a different codec. 



1- A multipoint control unit (MCU), including a 
multipoint controller (112) configured to perform call 
Signaling between said MCU (104) and a plurality 
of endpoints (102, 106) and a multipoint processor 
(110) configured to perform transcoding between 
codecs of different types, characterized by: 

a transcoding control unit (105) configured to 
direct said multipoint controller (112) to signal at 
least one of said plurality of endpoints (1 02, 1 06) to 
communicate using a predetermined codec so as 
to optimize said transcoding to one or more prede- 
termined criteria. 

2. An MCU according to Claim 1, wherein said trans- 
coding control unit (105) directs said multipoint con- 
troller (112) upon entry of an endpolnt Into a 
multipoint conference. 

3. An MCU according to Claim 1, wherein said trans* 
coding control unit (105) directs said multipoint con- 
troller (112) when an endpoint begins communica- 
tion. 

4. An MCU according to Claim 1 , wherein said criteria 
are to maximize quality. 
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An MCU according to Claim 1, wherein said criteria 
are to minimize transcoding required by said 
multipoint processor (110). 



6, A method for teleconferencing, Including trartscod- 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to telecommunl- s 
cations systems and, particularly, to an Improved sys- 
tem and method for multimedia conferencing. 
[0002] The ITU-T (International Telecommunications 
Union Telecommunications Sector) Recommendation 
H.323 defines a set of protocols for communicating us- je> 
ing audio, video and data over packet-switched net- 
works. To accommodate multipoint conferences (l.e„ 
those involving three or more parties), the Recommen- 
dation H.323 defines a multipoint control unit (MCU) to 
coordinate the conferencing. In particular, the MCU Is « 
required by the Recommendation H.323 to Include a 
multipoint controller (MC), which handles H.245 signal- 
ing. In addition, the MCU may include one or more 
multipoint processors (MP), which mix and process the 
data streams. 20 
[0003] Tha MPs may also provide conversion, or 
transcoding, between different codecs. However, typical 
MPs transmit at the highest quality codec each user will 
support, whether or not it is necessary. For example, if 
someone with a high quality G.711 codec is talking, us- 25 
Ing the "best codec" method allows everyone to receive 
the voice with the highest possible quality from the co- 
dec. However, if someone with a lower quality codec (e, 
g.. G.723) Is speaking, their voice is distributed to the 
G.711 users with G.711, which is wasteful 30 
[0004] Thfs process is illustrated schematically by 
way of an example in Table 1 and FIG. 1A and IB. in 
the example shown In Table 1, User A has GSM, G.723, 
and G.711 capabilities; UserBhaa G.711 and G.723 ca- 
pabilities; User C has G.723 capabilities; and User D 35 
has GSM capabilities. 



Table 1 



User A 


UserB 


UserC 


User D 


GSM 


G.711 


G.723 


GSM 


G.711 


G.723 






G.723 









[0005] As shown in FIG. 1 A, if User A communicates 
In a two-party conference with User B, G.711 win be 
used, if possible. If not, then Uib G.723 codecs will be 
used. Then, suppose User B calls User C and confer- 
ences in User C using the conference feature- The co- 50 
dec choice Is negotiated and the MCU 103 is inserted 
Into the media stream to provide transcoding. As shown 
In FJG. 1 B. the MCU 1 03 communicates with User A and 
User B using G.711, and with User C using G.723. If a 
User D having only GSM is added to the conference, 55 
then MCU 103 win communicate with the User D using 
only GSM. 

[0006] The amount of transcoding the MCU 1 03 must 



565 B1 2 

do depends upon which party is talking. When User A 
talks, User B receives the signal as is, and UserC and 
User D require transcoding. When User B talks. User A 
receives the signal as is, and User C and User D require 
transcoding. When User C talks, Users A, B and D re- 
quire transcoding. When User D talks. Users A, B, and 
C require transcoding. 

[0007] A similar systBm wherein transcoding is not 
minim&ed, but wherein each user receives at their high- 
est quality level, cs disclosed in US-An5.570.353 whilst 
WO 95 22318 A disdosBs another system for a plurality 
of independent users wherein the codecs cannot be ne- 
gotiated. 

[0008] The prior art thus is disadvantageous in that 
the MCU is required to perform transcoding which may 
be sub-optimal or even unnecessary. As such, the prior 
art MCUs can waste processing resources. 

SUMMARY OF THE INVENTION 

[0009] These and other drawbacks in the prior art can 
be addressed by a multipoint control unit (MCU) embod- 
ying the present Invention, as it is expressed in attached 
claims 1 and 6. According to one implementation, the 
MCU determines an optimal codec, for example, based 
on a highest quality "most common codec" among par- 
ties to a multipoint conference. Alternatively, the optimal 
codec may be chosen to minimize transcoding. Tha 
MCU instructs any parties not using that codec to rene- 
gotiate their connections with the MCU to employ that 
codec. The determination Is made as each party b add- 
ed to the multipoint conference. 
[0010] According to another embodiment, the codec 
optimization is made every time a different party talks. 
As each party is identified, the MCU issues commands 
to renegotiate the connections with the endpolnts. 
Again, the codec may be chosen to maximize quality or 
to minimize transcoding. 

[001 1] According to another embodiment, a particular 
party is chosen as having a default codec "mat party Is 
chosen as being allowed its highest quality codec, with 
other parties receiving at their highest qualities possible. 
However, when the other parties transmit, they send 
with a lower quality codec to preserve bandwidth. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0012] A better understanding of the invention is ob- 
tained when the following detailed description is consid- 
ered in conjunction with the following drawings in which: 

FIG. 1 A and FIG. 1 B Illustrate operation of an MCU 
according to the prior art 
RG. 2 illustrates a telecommunications network ac- 
cording to an embodiment of the Invention; 
FIG. 3 illustrates a multipoint control unit according 
to an embodiment of the invention; 
FIG. 4 is a flowchart illustrating operation of an em- 
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bodlment of the Invention; 
FIG. 5 is a diagram schematically illustrating oper- 
ation of an exemplary implementation of the inven- 
tion; 

FIG. 6 to a flowchart illustrating operation of an em- 
bodiment of the invention; 
FIG. 7 Is a diagram schematically illustrating oper- 
ation of an exemplary implementation of the inven- 
tion; 

FIG. 8 Is a flowchart Illustrating operation of an em- 
bodiment of the Invention; 
FIG. 9 Is a diagram schematically illustrating oper- 
ation of an exemplary Implementation of the inven- 
tion; and 

FIG. 1 0 Is a flowchart illustrating operation of anoth- 
er embodiment of the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

[0013] FIGs. 2-10 Illustrate an Improved multipoint 
conferencing system and method. An embodiment of 
the present Invention provides for more optimal selec- 
tion of codecs In a multipoint control unit. Optimal selec- 
tion of codecs may be based on minimizing bandwidth 
use, minimizing transcoding, or maximizing transmis- 
sion quality. Moreover, such optimization may occur ei- 
ther as new users are added to the multipoint confer- 
ence, or as particular users begin speaking. Finally, one 
or more users may be assigned a fixed higher or fower 
quality codec throughout the conference. 
[00141 Turning now to the drawings, and with partic- 
ular attention to FlG- 2, a diagram illustrating an exem- 
plary H.323 telecommunications system 100 according 
to an embodiment of the present invention is shown. It 
is noted that, while described specifically in the context 
of voice packets, the present invention encompasses 
thB use of any multimedia information, such as video, 
data, voice, or any combinations thereof. Moreover, an 
exemplary generic H.323 system is the Siemens Hi- 
Net™ RC 3000 system available from Siemens. 
[0015] The telecommunications system 100 includes 
a local area network (LAN) or packet network 101. Cou- 
pled to the LAN 1 01 may be a variety of H.323 terminals 
102a. 102b. 102c. 102d. a multipoint control unit (MCU) 
104 according to the present invention, an H.323 gate- 
way 106, an H.323 gatekeeper 108, a LAN server 112 
and a plurality of other devices such as personal com- 
puters (not shown). The H.323 terminals 102a, 102b, 
102c, 102d and H.323 gateway 106 and H.323 gate- 
keeper 105 are in compliance with the H.323 Recom- 
mendation. H.323 terminals 102 and H.323 gateway 
106 are each "and points' as may be discussed below. 
The H.323 sndpoints support H.245 control signaling for 
negotiation of media channel usage, Q.931 (H. 225.0) 
for call signaling and call setup, H.225.0 Registration, 
Admission, and Status (RAS), and RTP/RTCP for se- 
quencing audio and video packets. The H.323 end- 
points may further Implement audio and video codecs, 



T.120 data conferencing protocols and MCU capabili- 
ties. Further details concerning the H.323 Recommen- 
dation may be obtained from the International Telecom- 
munications Union. 
$ [0016] The MCU 104 includes a Transcoding Control 
Unit (TCU) 105. As shown in FIG. 3, the TCU 105 is 
coupled to a Multipoint Processor (MP) 110 and a 
Multipoint Controller (MC) 112. The MP 110 performs 
the actual media signal processing, i.e., switching, and 
™ the like. The MC 11 2 handles H.245 capability negotia- 
tions to determine existence of a common codec. As will 
be explained in greater detail below, the TCU 105 pro- 
vides for more optimal selection of the codec which is 
to be used. The TCU 105 is programmed with the codec 
75 information for each of the users. When the conference 
is set up, the TCU 105 determines what common codec, 
if any, each of the parties possess, and causes a sign- 
aling message, RenegotiateCodec, to be relayed to par- 
ties to the conference that they will have to use the com- 
20 mon codec If they are not currently using the common 
codec, they will need to renegotiate this portion of the 
call set-up with the MCU 104. It is noted that, while 
shown as discrete unhs, the MC 112, MP 110 and TCU 
105 may be embodied as one or more Integrated proe- 
25 essors. Thus, the figures are exemplary only. 

[0017] Turning now to FIG. 4, a flowchart Illustrating 
general operation of an embodiment of one aspect of 
the present Invention Is shown. First, In a step 400, the 
MCU 104 receives codec setup information concerning 
50 each of the parties on the network. The TCU 1 05 stores 
this information in a database (not shown), in a step 402. 
During a multipoint conference, the MCU 104 identifies 
the parties and accesses the database for their codec 
information, in a step 404. If predetermined optimization 
35 criteria are met through use of trie default codecs, then 
in a step 408, the connections 0 n step 412) are negoti- 
ated using the defaults. As will be discussed in greater 
detail bBlow, the optimization criteria may include mini- 
mizing transcoding, maximizing quality, or other desired 
<to criteria, Turning back to FIG. 4, if the optimization criteria 
are not met, then in a step 410, the MCU 109 and par- 
ticularly, the TCU 105 instructs the codecs of all con- 
cerned parties that the connections (In step 412) are to 
be renegotiated for optimal codec usage. 
45 [0019] A first embodiment of the Invention Is Illustrat- 
ed schematically by way of example with reference to 
FIG. 5. In the example of FIG. 5. the optimal coding 
choice to minimize transcoding is made every time a 
new user is added. In this example, the users have the 
so coding capabilities as set forth in Table 1 . Thus, User A 
has GSM, G.723, and G.711 capabilities; User B has G. 
711 and GJ23 capabilities; User C has G.723 capabil- 
ities; and User □ has GSM capabilities. 
[0019] If User A communicates with User B, G.71 1 will 
55 be used, if possible. If not, then the G.723 codecs will 
be used. Then, suppose User B calls User C and con- 
ferences in User C using the conference feature. The 
codec choice is then renegotiated on the fly as shown 
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In FIG. 5. That Is, User A will now communicate wfth the 
MCU 104 using G.723, User B will communicate with 
MCU 104 using G.723, and User C will communicate 
with the MCU 1 04 using G.723. Thus, In the example of 
FIG. 5. the User A and the User B will need to renege- s 
tlate (from G.71 1 to G.723). Once this Is done, no trans- 
coding Is needed because ail the codecs are G.723. 
[0020] Next, If a User D is added to the conference, 
the MCU 104 will communicate with it using GSM, since 
that Is the only codec supported by the User D. If GSM *o 
Is preferred by the MCU, then User A could be required 
to renegotiate the connection using GSM. 
[0021] As can be appreciated, depending on which 
party Is talking, the MCU 1 04 may have little or no trans- 
coding to do. When User A talks using G.723 coding, *5 
User B and C receive the signal as Is, and User D re- 
quires transcoding. When User B talks, Users A and C 
receive the signal as Is, and User D requires transcod- 
ing. When User C talks, Users A and B receive the signal 
as is, and User D requires transcoding. When User D ?<? 
talks, Users A, B, and C all require transcoding. Never- 
theless, the amount of transcoding needed Is less than 
In the case of FIG. 1A-1 B. Moreover, in this embodi- 
ment when each party is added, the optimal coding 
choice to minimize transcoding is made. For example, 2s 
if Users E, F, and G were added, an with only GSM ca- 
pabilities, then User A would be switched to GSM, since 
a majority of the users support GSM rather than G.723. 
[0022] Aflowcriartiilustratingopargitionofthisernboci- 
iment is shown in greater detail with reference to FIG. so 
6. In a step 602. the MCU 1 04 and. in particular, the TCU 
105 receives information concerning endpoints on thB 
network and their coding capabilities and stores them in 
a memory or database (not shown). In a step 654, the 
MCU 104 and, particularly, the MC 112, receives the 
multipoint conference cat) set-up commands, including 
identification of the users and their requested codecs, 
in a step 60S, the TCU 105 receives the identification 
end codec requests, and accesses the user-codec da- 
tabase to organize the users by type of codec and de- *o 
termine the most common codec. In certain Instances, 
a quality "floor or threshold may also be provided. Next. 
In a step 608, the TCU 105 determines whether the most 
common codec Is in use or has been requested by all 
the users to the conference. If so, then the conference « 
will proceed, in a step 61 0. If not, then in a step 61 2, the 
TCU 1 05 will cause the MC 1 1 2 to Issue a Renegotiate- 
Codec command to the relevant users. The Renegoti- 
ateCodec command may include, as a parameter, an 
identification of the particular codec which is to be used, so 
In a step 614, the relevant user sands a call satup com- 
mand which is received by the MCU 104*3 MC 112. The 
MC 112 recognizes the call setup command as pertain- 
ing to the particular conference and, in a step 616 un- 
dertakes the appropriate H.323 call control and signal- $5 
ing commands to set up the new connection using the 
new codec. Once the new connection has been estab- 
lished, in a step 616, the old connection is dropped. Fi- 



nally, In a step 620, the conference proceeds using the 
new codec selections. 

[0023] The embodiment described above modifies 
the coding choice as parties are added and dropped 
from the conference, in a second embodiment, howev- 
er, the coding choice is modified every lima a drfferent 
party talks. Thus, every time a new party talks, that party 
Es identified as the dominant party by the MCU 104 and 
the MCU 104 issues the proper signals to renagotiatB 
the rates with the endpoints. For example, turning to 
FIG. 7A, the example of Table 1 is again used, if User 
A is talking in a conference involving Users A, B, C, and 
D, then the connections should appear as in FIG- 7A, if 
the quality of the connection is to be maximized- That 
is, the Users A and B communicate with the MCU 104 
using G.711; the User C communicates with tha MCU 
104 using G.723; and the User D communicates with 
the MCU 1 04 using GSM. Alternatively; if transcoding s 
to be minimized, then the connections will ba as shown 
in FIG. 7B. Thus, Users A, B, and C alJ communicate 
with the MCU using GJ2Z; and User D communicates 
using GSM. 

E0024] A flowchart illustrating this embodiment of the 
invention is shown in RG- 8- In a step 602, the multipoint 
conference is set up via tha MCU 1 04. In a step 804 , the 
TCU 105 receives the user identification and codec re- 
quests, and accesses the user-codec database. In a 
step $06, the TCU 105 detects a new user talking. In 
response, in a step 808, the TCU 105 accesses the da- 
tabase to determine whether codec usage is optimized. 
As discussed above, codec usage may be optimized to 
maximize quality of minimize transcoding. Next In a 
step 810, the TCU 105 determines whether any of the 
users must renegotiate their codecs for optimization. If 
not, then In a step 824. the conference proceeds. How* 
ever, if they do, then In a step 312. the TCU 105 sends 
an identification of the user to the MC 112, The MC 112 
will Issue a RenegotlateCodec command to the relevant 
users In a step 314. The RenegotiateCoctec command 
may include, as a parameter, an identification of the par- 
ticular codec which is to be used. In a step 816, the rel- 
evant user sends a call setup command which is re- . 
ceived by the MCU 1Q4's MC 11 2, Tha MC 112 recog- 
nizes the call setup command as pertaining to the par- 
ticular conference and, in a step 818, undertakes the 
appropriate H.323 call control and signaling commands 
to set up the new connection using the new codec. Once 
the new connection has been established, In a step 820, 
the old connection is dropped. Finally, In a step 322, the 
conference proceeds using the new codec selections, 
until a new user talks and the system cycles back to step 
808. 

[0025] In another embodiment of the invention, the 
MCU 104 Is configured to receive an identification of a 
particular user as a primary user; ail others are identified 
as secondary. For example, in a teacher/lecturer envi- 
ronment, it may be desirable to provide the teacher with 
the highest quality codec whan speaking, but the stu- 
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dents wfth a lower quality one when questioning, Jn this 
case, the MCU 104 will cause the connection from the 
primary user and to the secondary users to be the high- 
est quality possible. The connection from the secondary 
users will be at a tower quality, to preservB system band- 5 
width. For example, assume that user capabilities are 
as defined in Table 1 . If User A is chosen as the primary 
user, then its connection to the MCU 104 will be made 
using G.71 1 . As shown in FIG. 9, the MCU 1 04 will com- 
municate to the Users B, C and D using their highest io 
quality codecs: G.711, G.723, and GSM, respectively. 
However, the Users B, C, and D will communicate to the 
MCU using a lower quality codec, if supported. Thus, 
User B will communicate to the MCU with G.723. 
This process is illustrated in greater detail with reference f£ 
to FIG. 10. As shown, in a stBp 950, tha TCU 10S re- 
ceives an identification of a primary and one or more 
secondary users. In a step 952, the multipoint confer- 
ence among those users begins. In a step 954, the sys- 
tem determines whether the primary user is speaking. 20 
If so, then In a step 960, the highest quality coding is 
used. If that coding is not currently being employed, then 
the connections are switched, In a manner similar to that 
described above. However, if In step 95S a secondary 
user was speaking, then In a step 858, lower quality co- 2s 
decs are used. If such coding te not currently being em- 
ployed, then the coding Is changed In a manner similar 
to that described above. 



Claims 

1. A multipoint control unit MCU (104), including a 
multipoint controller (112) configured to perform call 
signalling between said MCU (104) and a plurality 35 
of endpoints (102, 106), and a multipoint processor 
(110) configured to perform transcoding between 
codecs of different types, characterized by: 

a transcoding Control unit (105) configured to 40 
receive codec setup information concerning the 
coding capabilities of the endpoints (102, 106), 
determine codecs to be used by the endpoints 
(102, 10Q), and direct said multipoint controller 
(112) to signal at least one of said plurality of 45 
endpoints (102, 106) to renegotiate Its connec- 
tion to communicate using the determined co- 
dec so as to optimise said transcoding to one 
or more predetermined criteria. 

so 

2. An MCU according to Claim 1 . wherein said trans- 
coding control unit (1 05) directs said multipoint con- 
troller (112) upon entry of an endpotnt into a 
multipoint conference. 

55 

3. An MCU according to Claim 1, wherein said trans- 
coding control unit (1 05) directs said multipoint con- 
troller (112) when an endpoint begins communica- 



565 B1 3 

tion. 

4w An MCU according to any preceding Claim, wherein 
said criteria are to maximise quality. 

5. An MCU according to Claim 1 , 2 or 3, wherein said 
criteria are to minim czb transcoding required by said 
multipoint processor (110). 

6. A method for teleconferencing, including transcod- 
ing among two or more parties to a multipoint con- 
ference, employing a multipoint controller (112) per- 
forming call signalling between a multipoint control 
unit MCU (104) and a plurality of endpoints (102, 
106), with transcoding being performed between 
codecs of different types, the method being char- 
acterized by: 

optimising transcoding to one or more prede- 
termined criteria, by a transcoding control unit 
(105) receiving codec setup information con- 
cerning the coding capabilities of the endpoints 
(102, 106), determining codecs to be used by 
the endpoints (102, 106), and directing said 
multipoint controller (112) to signal at least one 
of said plurality of endpoints (102, 106) to re- 
nogiate Its connection to communicate using 
the determined codec. 

7. A method according to Claim 6. wherein said opti- 
mising optimises upon entry of new parties to a 
multipoint conference. 

6. A method according to Claim 6, wherein said opti- 
mising optimises upon a new party communication. 

3. A method according to Claim 6, 7 or 3, said prede- 
termined criteria comprising minimizing an amount 
of transcoding required to be performed by said 
transcoding. 

10. A method according to Claim 6, 7 or 6, said prede- 
termined criteria comprising maximizing a coding 
quality. 

11. A method according to Claim 6, 7 or 8, said prede- 
termined criteria comprising assigning one or more 
of said parties to a predetermined codec and others 
of said parties to a different codec. 



Patentansprflche 

1. Mehrpunkt-Kontrolleinheit MCU (104), enihattend 
einenMahrpunktcontroner (112), dersokonfiguriart 
ist, dass er die Anrufsignalislerung zwischsn der 
MCU (104) undzahlreichanEndpunktan (102, 106) 
ausfuhrt, und einan Mahrpunktprozessor (110), der 
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so konflgurlert 1st dass er die Codeumsetzung zwi- 
schen unterschied!lchen Codecarten ausfOhrt, ge- 
kennzeichnet durch: 

elne Ccxleumsetzungs-Kontrolleinheit (105), s 
die so konfigurtert iat, dass sie Codec-Einstdt- 
Information bezftglich der Codlerfahigkeiten 
der Endpunkte (102, 106) empfangt, die Co- 
decs festlegt, die von den Endpunkten (102, 
106) zu verwenden slnd, und den Mehrpunkt- io 
controller (112) anweist, mindestens einem der 
zahlrelchen Endpunkte (102, 106) zu signali- 
sleren, dass er seine Kommunikationsverbin- 
dung mtt Hllfe des festgelegten Codecs emeut 
aushandeln muss; damit die CodeunrBefzung is 
abh&ngig von einem Oder mehreren vorbe- 
stlmmten Krlterien optimiert wlrd. 

2. MCU nach Anspruch 1, worin die Codeumset- 
zungs-KontrolleInhelt(105) nach dem Elntritt eines 20 
Endpunkte In eEne Mehrpunktkonferenz dem Mehr- 
punktcontroKer (112) Anwelsungen erteilt. 

3. MCU nach Anspruch 1, worin die Codeumset- 
zungs-Kontrollelnhelt (105) dem Mehrpunktcontrol- 2s 
ler (112) Anweisungen erteilt, wenn efn Endpunkt 

mit der KommunikatEon beglnnt. 

4. MCU nach rrgendeinam vorhergahenden An- 
spruch, wobei die Kriterien dazu dienen, elne best- so 
mogiiche QuafitSt zu erzielen. 

5. MCU nach Anspruch 1 , 2 Oder 3. worin die Kriterien 
dazu dianen, die vom Mehrpunktprozessor (110) 
geforderte Codeumsetzung so gering wi© moglich 35 
zu halten. 

6. Verfahren fur sins TBlekonferenz, umfassend did 
Codeumsetzung zwischen zwei oder mehr Teilneh- 
mern an einer Mehrpunktkonferenz; und den Ein- 40 
satz etnes Mehrpunktcontrollers (112), der die An- 
njfslgnallsierung zwlschen elner Mehrpunkt-Kon- 
trollelnhett MCU (1 04) und zahlreFchen Endpunkten 
(102, 106) ausfOhrt, wobel die Codeumsetzung zwl- 
schen unterschiedllchen Codecarten erfolgt, und *s 
das Verfahren gekennzelchnet 1st durch: 

das Optimieren der Codeumsetzung anhand 
etnas odar mehrerer vorbestimmter Kriterien 
durch dine Codeumsetzungs-Kontrolleinhelt so 
(105), die Codao-Einstellinformation empfangt, 
die die Codierfahtgkeiten dar Endpunkte (102, 
106) beschreibt, von dan Endpunkten (102. 
1 06) zu verwendende Codecs festiegt und den 
MehrpunktcontrollBr (1 1 2) anweist, mindasiens 55 
einem der zahlreichsn Endpunkte (1 02, 1 06) zu 
signalisieren, dass er seine Kommunikations- 
vertiindung mlt Hilfe.des festgelegten Codecs 
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erneut aushandeln muss. 

7. Verfahren nach Anspruch 6, worin die Optimlerung 
beim Elntritt neuer Teilnehmer in eine Mehrpunkt- 
konferenz optimiert 

8. Verfahren nach Anspruch 6, worin die Optimlerung 
bei Komnurnikationsbeginn eines neuen Teilneh- 
mers optimiert. 

9. Verfa hren nach Anspruch 6, 7 oder 8 , wobei die vor- 
bestimmten Kriterien das Minimleren des Code- 
umsetzungsaufwands umfassen, den der Code- 
umsetzer leisten muss. 

10. Verfahren nach Anspruch 6, 7 Oder 8, wobel dfe vor- 
bestimmten Kriterien das Maximieren einer Codier- 
qualltSt umfassen. 

1 1 . Verfahren nach Anspruch 6, 7 oder 8, wobel die vor- 
bestimmten Kriterien umfassen, dass ein Oder men- 
re re Teilnehmer einem vor bestimmten Codec zuge- 
wieaen werden und andere Teilnehmer einem an- 
deren Codec. 



Revendlcations 

1. Une units de commands multipoints UCM (104), 
comprenant un organe de commande multipoints 
(112) configure pour efTectuer una signalisation 
d'appel antra ledit UCM (104) et una plurality de 
points terminaux (102, 106), et un processeur mul- 
tipoints (110) configure pour effectuer un transco- 
dage entre des codecs de types drfferenfs, carao 
terlsee par : 

une unite de commande de transcodage (105) 
configures pour recevoir des informations 
d'etablissBment de codecs concemant les 
prestations de codage des points fermlnaux 
(102, 106), determiner les codecs devant Stre 
utilises par les points termlnaux (102, 106), et 
dlrlger ledtt organe de commande multipoints 
(112)' pour signaler au molns Tun de ladlte plu- 
rality de points termlnaux (102, 106)aflndere- 
negocier sa connexion pour communiquar en 
utiltsant re codec determine de manierea opti- 
miser tedrt transcodage a un ou plusieurs enti- 
res predetermines. 

Z Un UCM salon la revendicaiion 1 , dans Eequel ladrte 
unite dB commande de transcodage (105) dlrige le- 
dit organe de commande multipoints (112) lors de 
I'Bntree d*un point terminal dans unB conference 
multipoints. 

3. Un UCM selon ta revendication 1 , dans lequel ladlte 
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unite de commands de transcodage (105) dirige le- predetermln6 et a d'autres desdltes parties un co- 

dit organe de commands multipoints (112) lore- dec different 

qu'un point terminal commence una communica- 
tion. 

5 ■ 

4. Un UCM salon una quelconque revendication pre- 
cedBnte, dans tequel lesdits criteres sont da maxi- 
miser la qualitB. 

5. Un UCM seton la revendication 1, 2 ou 3, dans le- *o 
quel lasdits criteres sont da minimisar la transcoda- 
ge requis par ladit processeur multipoints (110). 

6. Un precede dB teleconference, comprenant un 
transcodage parmi daux ou plusieurs parties a una 15 
conference multipoints, an em ploy ant un organs da 
commando multipoints (112) effBctuant una signa- 
lisation tfappBl enira una unite dB command© mul- 
tipoints UCM (104) at una pluralrta de points termi- 
naux (1 02, 1 06), la transcodage etant effectue entre 20 
das codecs da drffiarants types, le precede etant ca- 
racteriae par las eta pas oonsistant a : 

optimiser le transcodage a un ou pJusieurd Crv 
teres predetermines, a Paide d'une unite de » 
commande de transcodage (1 05) recevant des 
Informations d'etablissement de codec concer- 
nant les prestations de codage des points ter- 
mlnaux (102, 106). determiner les codecs de- 
vant etre utilises par les points termlnaux (1 02, so 
1 06), et dlriger ledlt organe de commande mul- 
tipoints (11 2) pour signaler au molns run de la- 
dlte plurality de points terminaux (1 02, 1 06) afin 
de renegoclersa connexion pourcommunlquer 
en utfllsant le codec determine. 

7. Un precede sslon la revendication 6, dans lequai 
ladite etape cortsistant a optimiser effectue una op- 
timisation tors da Ventre* da nquvallas parties a una 
conference multipoints- 

d. Un procada seton la revendication 6, dans (equal 
ladite etape consistent a optimiser effectue una op- 
timisation lore da la communication d'une nouvelle 
parte. 45 

9. Un procede selon la revendication 6, 7 ou 8, lesdfts 
criteres predetermines comprenant la minimisation 
d'une quantlte de transcodage devant etre eftec- 
tuee par ledft transcodage. so 

10. Un procede selon la revendication 6, 7 ou 8. lesdfe 
criteres predetermines comprenant la maximisation 
d'une qualite de codage. 



55 



1 1 . Un procede selon la revertdicatton 9, 7 ou 6, lesdiis 
criteres predetermines comprenant le fait cfassi- 
gnar a una ou plusfeurs desdites parties un codec 
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